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CALCULUS WORD PROBLEMS 


by 


EUGENE CHARNIAK 


Submitted to the Department of Electrical Engineering on July 12, 1968 
in Partial fulfillment of the requirements for the Degree of Master of Science. 


ABSTRACT 


A program was written to solve calculus word problems. The 
program, CARPS (CAlculus Rate Problem Solver), is restricted to rate 
problems. The overall plan of the program is similar to Bobrow's 
STUDENT, the primary difference being the introduction of "structures" 
as the internal model in CARPS. Structures are stored internally 
as trees. Each structure is designed to hold the information gathered 
about one object. 

A description of CARPS is given by working through two problems, 


one in great detail. Also included is a critical analysis of STUDENT. 


Thesis Supervisor: Joel Moses 


Title: Assistant Professor of Electrical Engineering 


I. INTRODUCTION 

The problems connected with computer understanding of general 
natural language input are at present beyond our abilities. Yet by 
limiting the context of the English input to a specific topic the problem 
is simplified in many ways. In a limited context a given word will have 
fewer possible meanings, so that there is less difficulty in deciding 
between meanings of a word. We also have the advantage of needing only 
a limited subset of English vocabulary and grammar. Finally, within a 
limited context certain words can be used to give clues to the meaning of 
a sentence as well as to the manner in which a sentence should be broken 
up into smaller sentences. 

Bobrow's STUDENT (2), a program which assumed that the input was 
an algebra word problem, was able to solve a large variety of problems 
with a remarkably small program. We have to a large extent taken our 
ideas from Bobrow's work. An understanding of STUDENT is sufficiently 
important to our work that we shall spend the second chapter analyzing 
Bobrow's program. 

The research described in this paper had as its goal the creation 
of a program which solves freshman calculus word problems. The program, 
CARPS (Calculus Rate Problem Solver), is restricted to rate problems. 
CARPS is written in two languages. The bulk of the coding is in LISP. 
There are, however, large sections which require a great deal of pattern 
matching, something for which LISP is not particularly powerful. These 
sections were written in CONVERT (3,4), a language especially designed for 


pattern matching. Because CONVERT is imbedded in LISP it was an especially 


convenient choice since we could easily switch back and forth between 
the two languages. Both of these languages were available on the 
Project MAC PDP-6 time sharing system which was used in this research. 
This system, which has a quarter million words of core storage, gave 
us a decided advantage over Bobrow, whose program had to fit into a 32K 
7094 LISP system, whereas ours wallows in the comparative luxury of 
45K of memory. 
Though CARPS is a fairly complex program, its basic organization 

is relatively straightforward. To demonstrate the underlying principles 
let us show how it would solve the following particularly simple problem. 
The parentheses and slashes are required by the PDP-6 LISP system. 

(A SHIP IS 30.0 MILES SOUTH OF POINT O AND TRAVELING WEST 

AT 25.0 MILES PER HOUR /. HOW FAST IS THE DISTANCE FROM THE 


SHIP TO 0 INCREASING?) 


POINTO , 


30 MILES 


aE 


as mires/nouR 


Fig. 1 


The diagram of this problem is for the benefit of the reader. CARPS does 
not use diagrams. 

The program is divided into five sections. The primary goal of the 
first section is to tag words with their part of speech. At the same time 
the program accomplishes several other tasks such as checking for words 
indicating the type of problem it has been handed. Just before it turns 


the transformed problem over to the next section it will print out 


(THE PROBLEM WITH TAGS ON IS) 

(((A SHIP (IS VERB) 30.0 (MILE UNIT) (SOUTH PNOUN) POINT O AND 
(TRAVELING VERB) (WEST PNOUN) (AT PREP) 25.0 (MILE UNIT) PER 
(HOUR UNIT)) (1.)) 

(( (HOW QWORD) (FAST RWORD) (IS VERB) THE DISTANCE (FROM PREP) 
THE SHIP TO 0 (INCREASING VERB)) (2.))) 


(THE PROBLEM TYPE IS) 
DISTANCE 


At the moment the program is familiar with two types of problems, 
DISTANCE and VOLUME. The second section of the program takes the output 
of the first section and breaks the sentences into simple sentences. 
After it has done so it will print; 

(THE SIMPLIFIED SENTENCES ARE) 
(((A SHIP (IS VERB) 30.0 (MILE UNIT) (SOUTH PNOUN) POINT 0) (1.)) 
((A SHIP (TRAVELING VERB) (WEST PNOUN)) (1.)) 
((A SHIP (TRAVELING VERB) (AT PREP) 25.0 (MILE UNIT) PER 
(HOUR UNIT)) (1.)) 
(( (HOW QWORD) (FAST RWORD) (IS VERB) THE DISTANCE (FROM PREP) 
THE SHIP TO 0 (INCREASING VERB)) (2.))) 
Note that the first sentence has been broken into three, while the second 
has been left unchanged. 

The third section is responsible for taking these simple sentences 
and transforming them into the model of the problem which the computer 
must have to solve it. The model used in the program is composed of 
equations and "Structures". A “structure" is basically a tree which has 
as its head the name of some object, and at various levels beneath the 
head all the information the program was able to abstract from the problem. 
(The second level corresponds to the property list of the head atom. The 
third level corresponds to the property lists of the atoms on the second 


level.) In our problem there is only one structure. It is most easily 


visualized in the following form. 


SHIP 
POSITION :G0007 VELOCITY: GOQ09 
WRTO :G0068 VALU? (TIMES 30.0 MILE) DIRECTION: (TIMES 1. -J) 
DIRECTION: (TIMES 1. I ) VALU: (QUOTIENT (TIMES 25.0 MILE) HOUR) ) 


The expressions G0007, GOO08, etc. are symbols generated by the LISP 
system. They are commonly called GENSYMS, and are used as fillers in 
the structures. 

Looking at the right hand node of the structure we see that the 
velocity of the ship is 25 miles per hour, and this velocity is in the 


-J direction. (The program assumes the co-ordinate system 


5 wa 


~ 


Fig. 2 


so ~-J would be west as it should be.) 
The left hand node can be intrepreted in the same way, except that WRTO 
stands for "With Respect To". This means that the ship's position was 
measured with respect to POINT 0 (GO008). 

The fourth section will generate the equations which the final section 
will solve. In this problem it must change the expression (DISTANCE (SHIP) 
(GO008)) to an actual distance equation. After it has done so the program 


prints out 


(THE EQUATION SET IS) 

((EQUAL (G0012) (EXPT (PLUS (TIMES 899.99998 (EXPT MILE 2.)) 
(TIMES 624.99998 (EXPT TIM 2.) (EXPT MILE 2.) 

(EXPT HOUR -2.))) 0.5))) 


Noting that T1M is the symbol for time we see that this is just the 


equation written in more usual notation is 


X = 900 MILES 4 + 625 T : MILES a7 HOUR 2 


The final section of the program will differentiate, simplify, and 
finally print out 


(THE ANSWER IS) 
Oo. 


This, of course, with either a little thought, or a little algebra can 
be shown to be the correct answer. CARPS took 41 seconds of machine time 
to solve this problem. 

As we mentioned previously the major influence to our work has been 
Bobrow's STUDENT. There is however other work which deserves mention. 
One may look at CARPS as a problem in utilizing a limited context to enable 
the program to accept natural language. In this respect Weizenbaum's 
work on ELIZA (9) is relevant. ELIZA is a program which accepts scripts 
which contain directions for analyzing the input sentences and producing 
a response. One ELIZA script was designed to act as a Rogerian psychiatrist. 
A user of the program with this script would sit down and type statements 
to the machine. The program would first analyze these statements for key 
words. With each key word are associated transformations, and the context 
of the key word which would make this transformation applicable. For 
example, if you typed YOU ARE VERY HELPFUL it would notice the key word 


YOU and eventually transform the sentence to the response WHAT MAKES YOU 
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THINK THAT I AM VERY HELPFUL. If there are no key words in the sentence 
the program generates a content free remark, or goes back to a key 
word found previously and produces some output based on it. 

As Weizenbaum has pointed out ELIZA accomplishes its goal by 
hiding its lack of knowledge of the "real world". A second ELIZA 
script (10) was written to do exactly the opposite. A typical 
conversation with it is 

The area of a circle is pi times the radius of the circle 
squared. 

The area of a sphere is pi times the diameter of the sphere 
squared. 

The diameter of an object is twice the radius of the object. 
The radius of a ball is 10. 

What is the area of the ball. 

THE ASSUMPTION THAT BALL IS CIRCLE IS CONSISTENT-SHALL I GO 
ON? no 

THE ASSUMPTION THAT BALL IS SPHERE AND OBJECT IS CONSISTENT- 


SHALL I GO ON? yes 
IT'S 1256.6359 


Once again the analysis is essentially a transformation based upon key 
words. 

The second ELIZA might also be considered a natural language question 
answering system. In this respect it is somewhat like SIR, (Semantic 
Information Retrieval) (7), a program written by B. Raphael. A conversation 


with SIR looks remarkably similar to the above with ELIZA. 


A nose is part of a person 
I UNDERSTAND 

A nostril is part of a nose 
I UNDERSTAND 

A professor is a teacher 

I UNDERSTAND 

A teacher is a person 

I UNDERSTAND 


Is a nostril part of a professor Q 
YES 


ll 


Contrary to ELIZA the input formats in SIR are strictly defined. As 
such SIR is really a study in storage of semantic information rather 
than work which concentrates on the recognition of such information. 
SIR also stores its information on the property lists of LISP atoms. 
The information from the first sentence would be stored by placing 

NOSE as a value of the property SUBPART of the atom PERSON, and the 
oppos-‘ite relation (i.e. SUPERPART) on the atom NOSE. As the above 
conversation indicates SIR can go through many levels of property lists 
to discover the answer to a question. 

Finally CARPS can be viewed as an extension of a symbolic 
manipulation program. A program such as CARPS would be much more 
difficult to write if it did not have this work to draw upon. In 
particular SCHVUOS, a simplification routine, and DIFF a differentiation 
routine, both written by J. Moses were used in this project. SCHVUOS 
and DIFF come from the routines SIN (Symbolic INtegrator), and SOLDIER 


(SOLution of Ordinary Differential Equations Routine) described in (6). 
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II. STUDENT 
As we mentioned earlier Bobrow's program, STUDENT, solves algebra 


word problems. It does this in the following manner: 


1) Performance of mandatory transformations on the English sentences 
of the input. Labeling of word and symbols in text (such as verbs, 
delimiters). 

2) Kernelization of sentences. 

3) Transformation of kernelized sentences into equations. 

4) Attempt at solution of equations. If successful then stop, else 
continue on. 

5) Addition to equation set of possible pertinent equations from 
memory. Realization that two variables which were considered 
independent are actually the same variable. 

6) Replacement of expressions by a possible alternate meaning. 


7) Requesting more information from the user. 


In the case of the last three stages an attempt is made to solve the 
equations after each stage, except for the last stage if the user has 


no more information to give. 


8) For the sake of completeness, we must mention the fact that new 
information can be inserted into the store of global information 
available to the program. Such insertion is independent of the problem 


solving procedure outlined above. 


However, in order to really understand how STUDENT works we should 


go through a problem and see how the program solves it. A typical problem 
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which STUDENT could solve is: 


(THE GAS CONSUMPTION OF MY CAR IS 15 MILES PER GALLON. 

IF THE DISTANCE BETWEEN BOSTON AND NEW YORK IS 250 

MILES, WHAT IS THE NUMBER OF GALLONS OF GAS USED ON A 

TRIP BETWEEN NEW YORK AND BOSTON Q.) 
In this problem we do not have any mandatory transformations, however 
many of the words will be tagged. (A typical mandatory transformation 


would be "twice" changed to "2 times".) After the words are tagged 


the problem would then look like: 


(THE GAS CONSUMPTION (OF/OP) (MY/PRON)CAR (IS/VERB) 15 

MILES PER GALLON(PERIOD/DLM) IF THE DISTANCE BETWEEN BOSTON 
AND NEW YORK (IS/VERB) 250 MILES , (WHAT/QWORD) (IS/VERB) 

THE NUMBER (OF/OP) GALLONS (OF/OP) GAS USED ON A. TRIP BETWEEN 
NEW YORK AND BOSTON (Q/DLM) } 


The next section of the program breaks the sentences into what 
Bobrow calls kernel sentences. In this problem the first sentence will 
not be changed, however, the second will. It will become (for the 


sake of convenience we will drop the tags) 


(THE DISTANCE BETWEEN BOSTON AND NEW YORK IS 250 MILES. 
WHAT IS THE NUMBER OF GALLONS OF GAS USED ON A TRIP BETWEEN 
NEW YORK AND BOSTON Q.) 


To understand exactly how this is accomplished we must know a little 

about METEOR, the language in which STUDENT was written. A METEOR 

program consists of a series of rules which are executed in sequence, 
subject to control statements in the rules. The left half of any rule is 
a pattern to be compared against the contents of the "workspace". 

(In our case the workspace would contain the sentence "If the distance...") 


If the pattern matches, the workspace is then changed to correspond to 
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that once we have translated our sentences into equations, all algebra 
word problems are alike, that is, they are all sets of linear equations 
with as many equations as unknowns. Hence, once the problems has 
been reduced to equation form, STUDENT does not need any heuristics 
to solve the equations. 
The second property is in my estimation even more serious. 
With one exception, each kernel sentence is translated into exactly 
one complete equation. As we shall show later (and it should not be 
too hard to convince oneself) this occurrence is not typical. The 
one exception in STUDENT to this rule occurs when we have a construction 
like: "A number is added to 18. This sum is 67." The first of the two 
sentences does not give a complete equation, but only, expressed in 
LISP notation, (PLUS (NUMBER) 18). However the "This" which starts 
the second sentence is the key to replace the part of the second sentence 
coming before the "is" by the equation fragment generated by the first 
sentence. So we get (EQUAL (PLUS (NUMBER) 18) 67), a complete equation. 
Since STUDENT can count on its input always forming equations, 
there is no provision for any other form of information storage. 
However, in a typical Calculus word problem we might have a sentence like 
"A ship is traveling east.", or "Water is flowing into a conical funnel." 
In each case there is information which should be stored, but clearly 
the equation form would not be the appropriate storage medium. 
Both of these criticisms stem directly from the type of problem 
Bobrow sets out to solve. There are other difficulties with STUDENT 
which were probably left unsolved because they were not critical. to 


the operation of the program and the size of the program had already 
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Las ay and "the" 7 
The program then tries to solve this set of equations and finds 


that it can not. It then prints out 


(USING THE FOLLOWING KNOWN RELATIONSHIPS) 

((EQUAL (DISTANCE) (TIMES (SPEED) (TIME) ) ) 

(EQUAL (DISTANCE ((TIMES (GAS CONSUMPTION) (NUMBER OF GALLONS 
OF GAS USED)))) 


(ASSUMING THAT) 
((DISTANCE)IS EQUAL TO (DISTANCE BETWEEN BOSTON AND NEW YORK) } 


(ASSUMING THAT) 
((NUMBER OF GALLONS OF GAS USED) IS EQUAL TO (NUMBER OF GALLONS 
OF GAS USED ON TRIP BETWEEN NEW YORK AND BOSTON) ) 


(ASSUMING THAT) 
((GAS CONSUMPTION IS EQUAL TO (GAS CONSUMPTION OF MY CAR) ) 


The equations are stored in a glossary ynder a key word. The first 

word of each variable (unless the variable starts with "number of", 

in which case "number of" is ignored) is looked up in the glossary and 
the corresponding equations pulled out. STUDENT then matches up the 
variables in the new equations with the variables already in the problem. 
To match up any two variables Pl and P2 we have the rule that if Pl 
appears later in the problem than P2 then Pl must be completely contained 
in P2 in the sense that Pl is a contiguous substring within P2. After 
having made these observations STUDENT again tries to solve the equations, 


succeeds, and prints out the 


(THE NUMBER OF GALLONS OF GAS USED ON A TRIP BETWEEN NEW YORK 
AND BOSTON IS 16.66 GALLONS) 


A close examination of STUDENT shows that it has some properties 


which make it less general than one would like. The first of these is 
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what is in the right half of the rule. The pattern which would match 
our sentence is (IF §$, (1/QWORD)$ ). What this means is that the 
workspace will match the pattern if the first word is "if" followed 
by any number of arbitrary words (that's what the $ means) followed 
by a comma, followed by any word which is labeled "QWORD" followed 
by any number of words. Clearly our sentence will match this pattern. 
The righthand side of this rule would look something like ((2 (PERIOD/DLM 
4 5) where the 2 refers to whatever was matched with the second object 
on the lefthand side. In this case it was the first $ (which matched with 
"the distance between Boston and New York"). The same goes for the 4 
and 5. 

STUDENT next transforms the simple sentences into equations. The 
general rule used here is that the word “is" is changed to an equal 
sign, and words like "times", "divide" are changed to their algebraic 
equivalents. STUDENT accepts seven different formats for questions. 
The specific manner in which a question sentence is changed into an 
equation will depend on the format. Roughly speaking the equation formed 
is an equality between a newly created atom and the quantity to which 


the question refers. Our problem will create the following equations 


{EQUAL XO0001 (NUMBER OF GALLONS OF GAS USED ON TRIP BETWEEN 
NEW YORK AND BOSTON) ) 


(EQUAL (DISTANCE BETWEEN BOSTON AND NEW YORK) (TIMES 250 (MILES) ))} 


(EQUAL (GAS CONSUMPTION OF MY CAR) (QUOTIENT (TIMES 15 
(MILES) ) (TIMES 1(GALLON)))) 


With the exception of X00001 (the newly created variable) our variables 


come directly from the words of the problem, ignoring any occurances of 
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reached the size of the available memory. These are: 1) A very 
limited subset of English grammar. STUDENT cannot handle something as 
basic to English as a dependent clause. In general one must be very 
careful in one's choice of sentences when addressing STUDENT. 2) A 
lack of sophisticated heuristics to determine the equality of variables 
previously considered independent. 3) A small knowledge of the "real 
world" and a rather inflexible manner of using that knowledge. 

Looking at this second criticism we see that Bobrow takes long 
English phrases from the problem as his variables and makes no attempt 
to analyze their structure. For example in the problem we just looked 
at "THE NUMBER OF GALLONS OF GAS USED ON A TRIP BETWEEN NEW YORK AND 
BOSTON" was a single variable. To determine that two different phrases 
are equivalent Bobrow has two rules. 1) If two phrases are identical 
except that one has a group of words where the other has a pronoun they 
are considered equivalent. For example "the number of guns the Russians 
have" and "the number of guns they have" will be considered equal. 

2) If the second phrase forms a contiguous block of the first, they are 
also considered equivalent. (We have already seen this rule in action.) 
There are many forms of paraphrasing that these rules will not cover 
("the volume of the pile" and "the pile's volume"). Moreover, in many 
cases these rules will equate objects which we would not want equated 
("street light" and "street"). A dramatic example of this situation is 
obtained by replacing the question in the problem above by "What is the 
number of gallons of gas used on a trip between Paris and Peking”. 


STUDENT would have still answered - 16.66 gallons. 
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III. AN OVERVIEW OF CARPS 

In the first chapter we presented a problem which CARPS was able 
to solve. In this section we wish to give an overview of the techniques 
CARPS uses in solving a word problem. This will enable those who do 
not wish to wade through the fine details presented later to get a basic 
idea of the program's operation. 


Let us use the following problem as an example. 


(A LADDER 20.0 FEET LONG LEANS AGAINST A HOUSE/. FIND THE 
RATE AT WHICH THE TOP OF THE LADDER IS MOVING IF ITS FOOT 
IS 12.0 FEET FROM THE HOUSE AND MOVING AWAY FROM THE HOUSE 
AT THE RATE 2.0 FEET PER SECOND/.) 


The first section, as we mentioned previously, will perform several 
kinds of operations upon the input string. The words in the problem 
are examined one by one. If the word FOO is to be tagged it is just 
replaced by (FOO PART-OF-SPEECH). Some common phrases are changed to 
an arbitrary standard form. In our problem the phrase AT THE RATE 
was changed to AT RATE. Also the program will change any occurance of 
IS followed by a verb to the verb by itself. CARPS also noticed that the 
word LADDER was a key word indicating equations which might be needed 


later. The output of the first section is 


(THE PROBLEM WITH TAGS ON IS) 

(((A (LADDER NOUN) 20.0 (FT UNIT) LONG (LEANS 

VERB) AGAINST A HOUSE) (1.)) (((FIND QWORD) (RATE RWORD) 
ATWHICH THE TOP OF THE (LADDER NOUN) (MOVING VERB) IF (ITS PRON) 
FOOT (IS VERB) 12.0 (FT UNIT) (FROM PREP) THE HOUSE AND (MOVING 
VERB) (FROM PREP) THE HOUSE (AT PREP) (RATE RWORD) 2.0 (FT UNIT) 
PER (SEC UNIT)) (2.))) 

(THE PROBLEM TYPE IS) 

DISTANCE 
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The next section will break up the sentences into simple sentences. 
This section is written in CONVERT. A CONVERT program, like a METEOR 
program, basically consists of a series of rules, each specifying a 
pattern which the input must match if the rule is to be used, and 
instructions as to what the program should do if the pattern is matched. 

For example our second sentence matches the CONVERT pattern which 


essentially looks for a sentence of the form: 


QUESTION WORD - ANYTHING - IF - ANYTHING 


SENTENCE: FIND RATE ATWHICH THE TOP OF THE LADDER MOVING 


PATTERN: QUESTION WORD ANYTHING 


SENTENCE: IF ITS FOOT IS 12.0 FT FROM THE HOUSE AND MOVING FROM THE 


PATTERN: IF ANYTHING 


SENTENCE: HOUSE AT RATE 2.0 FT PER SECOND. 
The rule then states that the sentence should be broken up into two 
sentences and the program restarted on each sentence. So we get the 
two sentences FIND RATE ATWHICH THE TOP OF THE LADDER MOVING. and ITS 
FOOT IS 12.0 FT FROM THE HOUSE AND MOVING FROM THE HOUSE AT RATE 2.0 
FT PER SEC. 

The first of these sentences cannot be broken up any further. 


The second however will match the pattern 


ANYTHING - VERB - ANYTHING - AND / WHILE - VERB - ANYTHING 


SENTENCE: ITS FOOT Is 12.0 FT FROM THE HOUSE AND MOVING 
PATTERN: ANYTHING VERB ANYTHING AND / VERB 
WHILE 


SENTENCE: AWAY FROM THE HOUSE AT RATE 2.0 FT PER SEC. 


PATTERN: ANYTHING 
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The rule here is to break the sentence in two, each having a noun phrase 
(matched by the first ANYTHING) as its subject, but a different predicate. 
Our sentence then becomes ITS FOOT IS 12.0 FT FROM THE HOUSE. and ITS 
FOOT MOVING AWAY FROM THE HOUSE AT RATE 2.0 FT PER SEC. The first of 
these is completely simplified. The second can once more be broken up, 
but we have already seen enough to get the basic idea of the process. 


After simplification the program prints. 


(THE SIMPLIFIED SENTENCES ARE) 

(((A (LADDER NOUN) (LEANS VERB) AGAINST A HOUSE) (1.)) 

((A (LADDER NOUN) (IS VERB) 20.0 (FT UNIT) LONG) (1.)) 
(((FIND QWORD) (RATE RWORD) ATWHICH THE TOP OF THE 

(LADDER NOUN) (MOVING VERB)) (2.)) 

(((ITS PRON) FOOT (IS VERR) 12.0 (FT UNIT) (FROM PREP) 

THE HOUSE) (2.)) 

(((ITS PRON) FOOT (MOVING VERB) (FROM PREP) THE HOUSE) (2.)) 
(((ITS PRON) FOOT (MOVING VERB) (AT PREP) (RATE RWORD) 2.0 
(FT UNIT) PER (SEC UNIT)) (2.))) 


Once the sentences are gimplified the program goes to the third 
and probably most important stage. It is here that we translate our 
simple sentences into the internal representation of the problem 
(i.e., into structures and equations). This takes place is two phases. 
Let us call them A and B. The first phase identifies the basic form 
of a sentence. The second phase further analyzes the sentence components 
recognized by phase A, and relates the sentences to the entire problem 
of which it is a part. Phase B concludes by filling out the structures. 
The entire procedure is applied to each sentence. 

The first sentence does not match any of the basic patterns used in 


building structures. The second sentence matches the pattern 


A LADDER Is 20 FT LONG 


NVP VERB NUMBER UNIT SINGLE ATOM 


NVP stands for No Verb Phrase. This means that it will match any group of 
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The LENGTH node is included just to remind us that it is still there. 


The equation generated is: 


(EQUAL (GO108) (DERIV(G0107 GO106 LADDER) ) ) 


GO108 is just a newly created variable. The expression (G0O107 G0O106 
LADDER) is the variable which represents the position of the top of 
the ladder. Note that G0106 is just the value of TOP, as GO107 is 
the value of POSITION. 

Since this section is so important, let us go through one more 


example before going on the section 4. The next sentence matches the 


pattern 
ITS FOOT Is 2.0 FT FROM THE HOUSE 
NVP VERB NUMBER UNIT POSITIONAL NVP 


A "positional" is a specially created class of adverbs and prepositions 
which indicate a positional relationship between two nouns. So this 
type of basic sentence is concerned with the position of one object 


with respect to another. The first noun phrase becomes 


LADDER 


FOOT :G0109 


The posses&ve pronoun is assumed to refer to the top level of the 
previous structure of the correct type. That is, ITS will refer to 
the previous nonhuman structure mentioned while HIS would refer to the 


previous human structure mentioned. 
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To this is added the fact that the foot of the ladder is 2.0 ft 
from the house. 


LADDER 
FOOT :G0109 


POSITION: 10 


VALU {TIMES 12.0 FT) DIRECTION? FROM W. : VERTICALSURFACE 


The POSITION node is put on because the sentence is one which basically 
deals with position. VERTICALSURFACE is just a general name for house 
in this context (also for fence, wall, etc.). In the same manner 
the rest of the sentences are translated into structure form. The 
final structure is shown on the next page (figure 3). 

The fourth section retrieves pertinent equations from memory and 
replaces the variables in the equations with specific references to 
the structures. This section notes that the problem type is DISTANCE. 
Looking on its keyword list it notes that the only keyword is LADDER. 


This causes it to pull the following equation out of memory 


(EQUAL (EXPT (LENGTH OBJ) 2.0) 
(PLUS (EXPT(POSITION TOP OBJ) 2) 
(EXPT (DISTANCE (FOOT OBJ) (VERTICALSURFACE) ) 2) ) 


This is just 


LENGTH? = HEIGHT” + DISTANCE TO VERTICAL SURFACE” 


VALU: (TIMES 20.0FT) 


VALU: (GIMES 12.0 FT) 


LADDER 


~ 


~. 


POSITION: GO107 


WRTO: WERT LCALSURFACE DIRECTION : FROM 


Fig. 3 


ia F Lo 


aioe 
ree: a 
eee a“ ‘ 
aaa eee get 
— ee i oun 
Pee 
lees ae cael 


FOOT :GOLQ2 


FA ; SS 


é aS 


vA 


VALU: Fine 


ssa 


a“ 


VELOCITY :G0113 


GOV 
ae 


PS 


20.0 FT)SEC) 


DIRECTION : FR 


OM 


%¢ 


25 


Also the variable OBJ is set to LADDER. (Note that the problem could 
have had the word "pole" or "rail" for that matter. The same equation 
would have been used, but OBJ would have been set to the respective 
word.) 

Now the program goes through the equation and replaces the 
variables with the information from the structures. the expression 
(POSITION TOP LADDER) is replaced by (G0107 GO106 LADDER). We have 
replaced the names of the markers by their VALU in the structure. 

The next variable is replaced by (TIMES 20 FT). The variable 
(DISTANCE (FOOT LADDER) (VERTICALSURFACE)) is replaced by an expression 


for the distance. The final replaced equations are: 


(THE EQUATION SET IS) 

1((EQUAL (GO108) (DERIV (GO107 GO106 LADDER) )) 
2(EQUAL (EXPT (GO107 GO106 LADDER) 2.) (PLUS 
(TIMES 400.0 (EXPT FT 2.)) (TIMES -l1. (EXPT ( 
PLUS (TIMES 12.0 FT) (TIMES 2.0 TIM FT (EXPT 
SEC -1.))) 2.))))) 


We now move to section five, which manipulates the final equations. 
Before the program can solve for (GO108) in equation one, it must first 
find an expression which relates (GO107 GO106 LADDER) to time, and 
contains no other variables. Equation 2 satisfies this criterion, 

so it is solved for (GO107...) and differentiated with respect to time. 
In this respect this problem is an easy one for CARPS. Other problems 
would require more equation manipulation before a suitable expression 
relating one of the variables to time could be found. It then notes 


that no boundary conditions were mentioned, so it assumed time = 0, 
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substitutes this into the equations, simplifies, and prints 


(THE ANSWER IS) 
(TIMES -1.5 (EXPT SEC -1.) FT) 


Which in more standard notation is -1.5 FP / SEC. 

Before we move on to a detailed exposition of CARPS, we would 
like to make explicit a few points which did not come out in the 
previous discussion. 

We have chosen to break sentences up into smaller sentences. There 
is some theoretical justification for doing so, that is the work of 
the transformationalists in linguistics. However the primary reason 
was that a sentence is the most self-contained small unit of information 
which is currently available. While it is true that the individual 
sentence is not always self-contained, (e.g., a sentence containing a 
pronoun or understood object) it is frequently so; the exceptions can 
be treated individually. 

To a limited extent CARPS can use knowledge of the real world to 
parse a sentence. Its knowledge of cones (see the example of chapters 
four, five and six) enables it to recognize in a problem which deals 
with cones that THE RADIUS refers to THE RADIUS OF THE BASE OF THE CONE. 

We decided on the use of structures for several reasons. Given 
the property lists and the functions for manipulating them in LISP, 
structures are a natural form of information storage. 

Together with deeper grammatical analysis of noun phrases, 
structures also help us go a long way toward solving the paraphrase 


problem which Bobrow encountered. Suppose the phrases CONICAL PILE 
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and PILE OF SAND were encountered in a single problem. STUDENT would 
not realize that they might be the same object. CARPS however would 


analyze the first as 
PILE 
SHAPE : CONICAL 


and the second as 
PILE 
CONTENTS : SAND 
which would give us 


We 
SHAPE : CONICAL CONTE : SAND 


Finally structures allow us to store interrelated information 
according to their relationships. Though this has not been shown 
clearly so far, the problem we will analyze in the next section will 


show exactly how useful structures are in this respect. 
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IV. WORD TAGGING AND SENTENCE DECOMPOSITION 
If we are to really understand the workings of CARPS we should go 
through a problem in great detail. Consider the following problem: 
(WATER IS FLOWING INTO A CONICAL FILTER AT THE RATE OF 15.0 CUBIC 
INCHES PER SECOND/. IF THE RADIUS OF THE BASE OF THE FILTER IS 
5.0 INCHES AND THE ALTITUDE IS 10.0 INCHES/, FIND THE RATE AT 
WHICH THE WATER LEVEL IS RISING WHEN THE VOLUME IS 100.0 CUBIC 


INCHES /.) 
5,0 IN 


ee. 
ae 


10,0 IN 


Fig. 4 
In the first section of the program each word is checked to see 


if it has a property on its property list under the indicator GRAMMAR. 
If it does the value of this property will be a function, which will then 
be evaluated. The net result of the evaluation will be one of the 
following. 

1) The current word (i.e., the word whose property list we just 
checked) will be tagged with its part of speech. 

2) If the word under consideration is a question word (such as 
FIND or HOW) the ensuing words will also be checked to see if they 
give any clue as to the type of problem we are dealing with. That is, 


the property lists of the words will be checked for the identifiers 
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PTYPE and GRAMMAR and any value noted. The logic behind this action 
is that the most reliable place to look for clues to the problem type 
is where the information is actually requested, i.e., in the question. 
This action will be terminated when the sentence ends or when a word 
is encountered which indicates that the rest of the sentence is not 
part of the question proper. In our problem FIND is the question 
word, and the word LEVEL, which in this context usually means altitude, 
is the clue that the problem is one which deals with volumes. The 
search for such clues was ended in this problem upon the encounter of 
the word WHEN. 

3) The current word is noted as a key word (meaning it has 
equations associated with it in memory), the sentence however is left 
unchanged unless, of course, the word is also to be tagged with a 
part of speech. (The only key word occuring in our problem is 
CONICAL. ) 

4) The word may be the signal word for a mandatory transformation 
in which case the local context of the word is checked and if correct 
the transformation is performed. In this problem we have several of 
these transformations. The phrases AT THE RATE OF and AT THE RATE are 
changed to AT RATE. (The Signal word here is RATE.) Cubic inches is 
changed to IN3, AT WHICH is changed to ATWHICH. There are many others 
as a glance at the output will show. 

5) At the end of a sentence (as indicated by a "?", ".", or ";") 
the end punctuation is deleted, and the sentence given a tag with a 


number indicating its order in the problem. 
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If a word has no GRAMMAR on its property list it will be checked 
for two conditions. If it ends in ING it will be labeled VERB. If 
it ends in LY it will be labeled ADV. Though there are many 
exceptions to these rules the limited vocabulary encountered in these 
types of problems does not include any that we have been able to find. 

After this section is through, our problem will look like this: 

(((WATER (FLOWING VERB) (INTO PREP) A (CONICAL ADJ) FILTER (AT 
PREP) (RATE RWORD) 15.0 (IN3 UNIT) PER (SEC UNIT)) (1)) ((IF THE 
RADIUS OF THE BASE OF THE FILTER (IS VERB) 5.0 (IN UNIT) AND THE 
ALTITUDE (IS VERB) 10.0 (IN UNIT) /, (FIND QWORD) (RATE RWORD) 
ATWHICH THE WATER LEVEL (RISING VERB) WHEN THE VOLUME (IS VERB) 
100.0 (IN3 UNIT)) (2))) 

At this point the program looks over the list of words which it 
has accumulated to indicate the problem type. If the majority indicate 
one type of problem, the indicator PROBTYPE is set to that name. 
Otherwise the program will print an error message and halt. 

The next section of the program breaks the sentences into simple 
sentences. Since we treat this as a problem of pattern matching, it 
is written in CONVERT. At the present moment we have sixteen rules 
in this part of the program. They cover a large portion of compound 
and complex sentences. These rules are listed in Table l. 

Though we will not use actual CONVERT notation it would be useful 


if one had a slight idea of how the language operated. 


CONVERT is used like any other LISP function, that is 
(LAMBDA (ARG1 ARG2....) (CONVERT M E I R)) 


It has four arguments, as indicated by the ME IR. The first two are 


ABYTEING 


ANYTEING 


MIPS TION 


AND/AHTLP 


AZORES 


ANYTHING 


AND/VHILF - 


ANYTHING - VERB/PREP - 


ANYTEING ANYTHING 


- VERB/PREP - 


ANYTHING 


EP - PREP/ADVEFL - 


ANYTHING 


TABLE 1: SECTION 2 


EXAHPLY 


lf - the radius is 3 ft - , - what 
is the altitirte 


What - is the altituce - if - 
is 3 ft 

- is the altituwie - when - the 
raiius is 7? ft 
when-the radius 18 3 ft-what-is the 
altitudes 
fhe radius - is - 3 ft - and - 


inureasingy - at 


y) 
as 
aa 
& 
5 
5 
ao 


The radius - is ~ 3 ft - and - the 
altitude - is 5 


The cone - whose ~- radius - is - 3 ft 


Laaeae 5 


has ~- an altituce of 5 ft 


A man walks - toward - a lidht - 
whese - height - is 20 ft 

A man walks toward - - which 
is - 20 ft hig 

A man - , - Startina at. S PM - , - 


walks toward a light 


A box - is - 1G ft long - , - 3 ft 
wide - , - ang *t high 


A man - walks - directly - toward a 
light 


A man - walks - toward - a liqut - 
at - 2 miles per hour 


the radius 


US 
To break up sentences whicn contain 
a subordinate clause introduced by IPF 


Same, excert that clause occures at 
the end of the sentenco 


Separate off from the sentence a 
subordinate clause, introduced by WHEN 


yt that clause eccurs at the 


Same, exce 


heqinning of the sentence 
To break ur a sentence which contains 
two predicates, ccnnected hy AND or 


VEILE 


To separate two comrlete sentences 
joined by AND or WHILE 


To separate a subordinate clause 
introduces by WHOSE 


Same, except that clause occurs at the 


end of the sentence 


To 
introduced hy & 


darate a subordinate clause 
IC or THAT 


Te separate an appositive set off ; 


commas 


To separate a sentence with 3 objects 
or predicate adjectives 


To create a new sentence with the 
adverb and verb as its provdicate 


To “reak up 2 predicate pnrases, tne 
first starting with a oreo, the 
second with a prep or advert 


Te 
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used to define the variables of the program. The third is the list 
which is the input to the program. If the LAMBDA has more than one 
argument they must be made into a list by the argument I (i.e., I would 
be (LIST A B) ) as the final argument R, the list of rules, will only 
accept one list as its input. 

R is cOémposed of one or more sections, each of which has a name 
and consists of one or more rules. In a given section the input is 
matched against the left half of the rule. If it matches, the value 
of the function is just the value of the righthand side of the rule. 
Should none of the patterns in the section match, the value of the 
function is just the unmatched expression. If a rule does apply, 
however, the righthand side may give control information, like "the 
value of this expression is just the value of the entire program 
started over, on the expression '(A XQ D)'". This is just a 
recursive call. If none of the patterns in a given section match the 
expression the value of the program in just the input expression. 

Let us start with the second sentence, since it is somewhat 


easier to explain than the first. The pattern which will match this is 


IF - ANYTHING - , - QUESTION WORD - ANYTHING 


IF THE RADIUS OF THE BASE OF THE FILTER IS 5.0 IN AND THE ALTITUDE 


IF ANYTHING 
IS 10.0 IN , FIND RATE ATWHICH THE WATER LEVEL RISING WHEN 
' QUESTION WORD ANYTHING 


THE VOLUME IS 100.0 IN3 
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The right side of the rule specifies that we begin the program over, 


but break the sentences in two. In our case the two sentences are 


THE RADIUS OF THE BASE OF THE FILTER IS 5.0 IN AND THE ALTITUDE IS 10.0 
IN and FIND RATE ATWHICH THE WATER LEVEL RISING WHEN THE VOLUME IS 
100 IN. 


The first of these sentences will then match the rule; 


ANYTHING - VERB - ANYTHING - AND/WHILE ~- ANYTHING - VERB - ANYTHING 


THE RADIUS OF THE BASE OF THE FILTER Is 5.0 IN AND 


ANYTHING VERB ANYTHING AND/WHILE 


THE ALTITUDE Is 10.0 IN 


ANYTHING VERB ANYTHING 


This rule matches the case where an AND or a WHILE connects two 
complete sentences. It then recurses on each of the two sentences 
separately. The two sentences formed in this way (i.e., THE RADIUS OF 
THE BASE OF THE FILTER IS 5.0 IN and THE ALTITUDE IS 10.0 IN) will not 
Match any more patterns so they will remain in their present form. 

The second sentence we mentioned above (FIND THE RATE ATWHICH...) 


will be broken up by the rule 
QUESTION WORD - ANYTHING - WHEN - ANYTHING 
FIND RATE ATWHICH THE WATER LEVEL RISING WHEN 


QUESTION WORD ANYTHING WHEN 


THE VOLUME IS 100.0 IN3 


ANYTHING 


This rule is fairly straight forward in the sen 


the dependent clause introduced by WHEL 


sentence. However, in the process the WHEN 


sentence. This action is more important than 


The word WHEN in calculus problems is aimost ais 


the boundary condition. That is, it precedes a 
only be substituted into the equations after tn 
accomplished. A good tilustration cf this woul 
“At what rate is the radius increasing when the 
Clearly if we substituted in the value first we 


Matter what the rest of the problem said. In 


information the word WHEN is added to the tag of 


we 


value 


d he the 


rad 


would 


created by this rule. The two sentences formed by this ruie 


RATE ATWHICH WATER LEVEL RISING and THE VOLUS 
be broken up any further. 
Let us now return to the first sentence. 
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our sentence into two again, each having one of the two original phrases 


which began with prepositions. So we get WATER FLOWING INTO A CONICAL 


FILTER and WATER FLOWING AT RATE 15.0 IN3 PER SEC. 
With this transformation our sentences are completely broken up 


as far as the program in concerned. Our problem now looks like (with 


the word tagged just to remind us that the tags are still there) 


(((WATER (FLOWING VERB) (INTO PREP) A (CONICAL ADJ) FILTER) (1)) 
((WATER (FLOWING VERB) (AT PREP) (RATE RWORD) 15.0 (IN3 UNIT) PER 
(SEC UNIT)) (1)) ((THE RADIUS OF THE BASE OF THE FILTER (IS VERB) 
5.0 (IN UNIT)) (2)) ((THE ALTITUDE (IS VERB) 10.0 (IN UNIT)) (2)) 
(((FIND QWORD) (RATE RWORD) ATWHICH THE WATER LEVEL (RISING 
VERB)) (2)) ((THE VOLUME (IS VERB) 100.0 (IN3 UNIT)) (2 WHEN))) 
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V. TRANSFORMATION OF SENTENCES INTO THE INTERNAL MODEL 

We now come to the main section of the program. It is in section 
3 that we try to abstract the information in the sentences, and 
place this information conveniently in our model. 

Before we go into the workings of this section, let us take 


another look at the representation of structures. 


SHIP 


VELOCITY :GO001 


VALU : (QUOTIENT (TIMES 15 FT) SEC) 


We see that we have put the tag VELOCITY on the atom SHIP with the 
value GOO001. Then on the property list of this atom we put the 
property VALU with the value (QUOTIENT (TIMES 15 FT) SEC). 

The value of the velocity is not placed on the property list of 
SHIP directly for two reasons. One is based on detailed programming 
considerations. The second is the fact that we may wish to put more 
information concerning the velocity into the structure, such as the 
direction of the velocity. It seemed to us most logical to have this 
information also hanging from the VELOCITY node. This requires that 
the value of velocity be an atom from which we can hang more information. 
This atom must be a gensym and not an arbitrary label. If it were the 
latter, and we put the value of another velocity into our model we would 


erase the first value unless we took some rather complex precautions. 
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Upon entering phase A with the first sentence we check for two 
conditions. If the word WHEN is in the tag, then a flag is set. We 
then check to see if the sentence is a question. In this case the 
sentence is routed to a special section which deals only with questions. 
If not, it will go to one of two possible sections depending on the 
problem type (since certain types of problems tend to have preferred 
types of sentences). However if no match is found in the first section, 
the other will be tried. A list of the various classifications of 
sentences in phase A is found in Table 2. 

The first sentence will not match any pattern and will be placed 
on the special list for unmatched sentences. The second sentence will 


match the pattern 


WATER FLOWING AT RATE 15.0 IN3 PER SEC 


NVP VERB PREP ANYTHING NUMBER UNIT PER TIMEUNIT 


This format indicates that the object mentioned by the noun phrase is 
changing at a given rate. The rate is restricted to time simply 
because all our problems have only time rates. 

We now enter phase B. It notices that IN3 is a unit of volume, 


so we get the structure: 


WATER 


VOLUME : GOONIS 


VALUE: (QUOTIENT (TIMES 15.0 (TIMES T1M (EXPT IN3)))SEC) 
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TIM is the internal symbol for time. Notice that the rate has been 
automatically integrated to a volume. 
If we had "Water flowing at 15.0 MILES per hour." we would have 


created instead: 
WATER 
VELOCITY :GOO15 


VALU: ETC. 


The program now realizes that this sentence indicates volume 
change. It will then go and look at the previous unused sentences to 
see if it can find one of the form, (WATER FLOWING-preposition- 
nounphrase) This would indicate that water is the contents of whatever 
corresponds to the noun phrase. This indeed matches our first sentence 
with noun phrase = (A CONICAL FILTER). Phase f then calls the program, 
PVA, which analyzes noun phrases. In Table 3 we have a list of the 
operations PVA can perform. PVA, after applying a few tests which fail, 
strips the phrase of all occurences of A and THE. It then notes that 
conical is an adjective and that SHAPE is the value of the property 
ADJTYPE on its property list. Then this information, as well as the 


contents of the filter, is put into structure form and we get: 


FILTER 


CONTENTS : WATER SHAPE : CONICAL 
VOLUME :GO0015 


VALU:ETC 


PATTERN 


ANYTHING - OF - 
A/THE/PRONOUN - ANYTHING 


ANYTHING - OF ~ NO NUMBER 


ANYTHING ~ DISTANCE ~ FROM - 


ANYTHING ~ DISTANCE - 
FROM/BETWEEN - ANYTHING - 
TO/AND ~ ANYTHING 


POSSESIVE PRONOUN - ANYTHING 


SINGULAR PRONOUN 


PLURAL PRONOUN 


ADJECTIVE ~ ANYTHING 


TABLE 3: PVA 


EXAMPLE 


the radius - of - the - base 


a pile - of - sand 


the train's - distance ~ 


The - distance - between - 
the train - and - the ship 


its - altitude 


he , she , it 


they 


red balloon 


BASE 


RADIUS :GOOO1L 


PILE 


CONTENTS : SAND 


TRAIN 


POSITION:G0001 


DIRECTION:FROM WRTO:SHIP 


as above 


FILTER 


ALTITUDE :GO001 


BALLOON 


COLOR: RED 


COMMENT 


Only used in volume problems 


Filter was the name of the 
previous non human structure 
mentioned in the problem 


Return the name of the last 
human or nonhuman structure 
mentioned 


Return names of last two 
different structures mentioned 


TY 
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Note that PVA is applied to all noun phrases. In the second sentence 
it was applied to WATER, but naturally it was not able to break it up 
further. The fact that atoms are unique in LISP comes in very handy 
here. When we put WATER on the property list of FILTER we are 
guaranteed that all the properties associated with WATER (VOLUME in 
this case) will tag along. 

The third sentence (THE RADIUS OF THE BASE OF THE FILTER IS 5.0 


IN) will match 


THE RADIUS OF THE BASE OF THE FILTER IS 5.0 IN 


NOUN PHRASE Is NUMBER UNIT 


PVA is applied to THE RADIUS OF THE BASE OF THE FILTER. It first notices 


that this is of the form 


(THE RADIUS)OF (THE BASE OF THE FILTER) 


However the right hand side of the above, (THE BASE OF THE FILTER) is 


also in this form, so we first analyze it, which gives us 


FILTER 


BASE :G0016 


We then analyze the entire phrase giving 


FILTER 


BASE :G0Q16 


RADIUS :G0017 
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Finally PVA returns this structure and on the property list of GO017 
is put VALU: (TIMES 5.0 IN). 

The fourth sentence (THE ALTITUDE IS 10.0 IN) matches the same 
form. Since the phrase THE ALTITUDE cannot be broken up any further, 
PVA analyzes it as a Single level structure made up of the single atom 
ALTITUDE. 

To understand how the fourth sentence is handled we must backtrack 
somewhat. When we encountered the phrase CONICAL FILTER we put conical 
on the property list of filter. The program knows that conical objects 
have many properties in common. For example they all have altitudes 
and bases, and the latter has a radius. So these facts are put on the 
structure of filter. Hence much of the structure we have shown being 
created had already been placed on the structure as a common property 
of cones. Nevertheless at each step the system actually did create 
the substructure finding, however, that the information was already 
on the property lists. 

There is one other operation we have so far neglected. Every time 
a property X is put on the atom Y, a property MARKERON is placed 
on the atom X, and this has the value Y. This gives us backwards 
pointers so that given a property we can find out which atoms have that 
property. Furthermore if the value of Y is Z, and Z is an atom, on the 
property list of Z will appear VALUON:(X Y). .If Z is the value of more 
than one x,y pair all such pairs will be listed. Since we had already 


created the substructure 
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FILTER 


ALTITUDE :G9002 


on the property list of altitude was a pointer to FILTER. Hence when 
PVA returned the single level structure ALTITUDE, the program checked 
to see if ALTITUDE was on the property list of any other atom. Finding 
that it was a marker on FILTER the program assumes that ALTITUDE refers 


to the altitude of the filter, and creates the substructure 


FILTER 


ALTITUDE :G9002 


VALUE: (TIMES 10.0 IN) 


The next sentence is the question (FIND RATE ATWHICH THE WATER 
LEVEL RISING). Since we have illustrated this question format already 
in chapter one we will not do so again. PVA again analyzes the noun 


phrase WATER LEVEL and gives 


WATER 


ALTITUDE :G0019 


It does this because the program knows that LEVEL in this context 
“(noun phrase) LEVEL" means ALTITUDE. (This information is stored on 
the property list of level.) 

Once again WATER is only on the property list of FILTER, so we 
can trace back and find that what we are interested in is (GOQ0O19 WATER 


FILTER). This is the equation variable format. This variable represents, 


in English, the altitude of the contents of the filter. So we create 


the equation 


(EQUAL GOO020 (DERIV(GO019 WATER FILTER) )) 


The interpretation of the last simple sentence (THE VOLUME IS 
100.0 IN3) depends on the same sort of analysis. The word volume 
only appears as a marker on water, so the program assumes the sentence 
is refering to this volume. However since the tag for this sentence 


has the word WHEN, the structure created is 


FILTER 


a 


CONTENTS : WATER 


gee 


VOLUME : ETC WHEN :GQ021 
VOLUME :GQ020 
VALU: (TIMES 100.0 (EXPT IN 3)) 


The WHEN on the property list of WATER indicates that what follows 
beneath it is a boundary condition. 

At this point all the necessary information has been extracted 
from the sentences, and this stage of the solution is over. The final 


structure is illustrated on the next page. 
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VI. THE FORMATION OF THE EQUATIONS AND THEIR SOLUTION 

The fourth section isconcerned with establishing the equations 
which the fifth section will manipulate to solve the problem. The 
program first checks the problem type. Finding that it is VOLUME it 
then checks the keyword list, which has the single element CONICAL. 
The property list of CONICAL is now checked. By this time CONICAL has 
the backwards pointer VALUON(FILTER SHAPE) which tells us that filter 
is our only conical object. We then pull out the equations connected 
with the word conical. We also set the variable OBJ to FILTER so we 
will know exactly what is conical. Note that rather than talk about a 
conical filter we could have mentioned a “cone". This would cause no 


problem since the word cone is defined in our dictionary by 
CONE 
SHAPE : CONICAL 


(Actually it is defined by a LISP function which says that when cone is 
encountered in the right context, one should give it the properties of 
a conical object. Otherwise we would always have a backwards pointer 
from CONICAL to CONE even in problems which did not mention cones.) 

In the case of distance problems, a routine is always called which 
can set up a distance equation between two objects, given their names. 
It does this with the information stored in the structures of the two 
objects. While finding the velocity and position of each object it notes 
their direction. In the case of velocity it also notes at what time the 


motion began (if no time is specified it assumes t = 0). The program checks 
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to see if all positions are measured with respect to the same co-ordinate 
system, returning an error message if not. It then collects the position 
and velocity vectors in the same direction into a single term. It will 
return the square root of the sum of the squares of the terms. The 
program is able to handle some cases of the equivalence between the 
distance from an object to the ground (or street) and the altitude of 
that object. 

There will be two equations (other than the one already created 
by the question sentence). One relates the volume of the contents of 
a cone to the altitude and radius, and the other relates the height 
and radius of our cone to the height and radius of the contents of the 
cone. Since the equations are stored in memory all parameters are 
represented by lists which specify what piece of information is 
acceptable as the value of this parameter. For example, if the parameter 
represented the altitude of some object, its representation would be 
(ALTITUDE OBJ). Before these equations can be used, these lists must 


be replaced by their values. Consider this equation used in this 


problem: 
(EQUAL (TIMES (RADIUS BASE CONTENTS OBJ) 
(ALTITUDE OBJ) ) 
(TIMES (ALTITUDE CONTENTS OBJ) 
(RADIUS BASE OBJ))) 
This is the relationship, R/CR=A/CA as seen in 


the diagram 


h 


Ac 


ye 
RG 


Fig. 6 
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(For a list of equations which CARPS has available as well as examples 
of other types of information CARPS knows about certain words see 
Table 4.) 

Before the parameters are replaced an extra copy is set aside to 
be used later when we solve for the boundary condition. The program 
will then go through the list structure noting that EQUAL and TIMES 
are algebraic symbols. It will then come to (RADIUS... ) and note 
that this is not an algebraic symbol, implying that the list of which 
RADIUS is the first element is a variable name. Processing the variable 
in reverse order, it first finds that the value of OBJ is FILTER. It 
then looks for the contents of FILTER, which is WATER, and then for 
the BASE of the WATER, which it does not find. Hence it leaves this 
variable with only the last two elements replaced (e.g., (RADIUS BASE 
WATER FILTER)). It will find the altitude of the filter however, and 
note that it has the property VALU whose value will then replace this 
entire expression in the equation. In this same manner the rest of the 
equation set will be filled, and the computer prints out: 

(THE EQUATION SET IS) 

1 ((EQUAL (GO005) (DERIV (GO004 WATER FILTER)) ) 

2 (EQUAL (QUOTIENT (TIMES 17.0 (TIMES (EXPT IN 3) T1M)) SEC) 
(TIMES (GO004 WATER FILTER) 0.33333300 PI 
(EXPT (RADIUS BASE WATER FILTER) 2) )) 


3 (EQUAL (TIMES (RADIUS BASE WATER FILTER) (TIMES 12.0 IN)) 
(TIMES (GO004 WATER FILTER) (TIMES 5.0 IN)))) 


da 
GO00S = at ALTITUDE 


{17 IN°/SEC)t = Hi RADIUS" ALTITUDE 


wie 


12 IN * Radius = 5 IN * ALTITUDE 
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TABLE 4: KNOWLEDGE ABOUT WORDS 


KNOWLEDGE IN THE FORM OF EQUATIONS fa 
aca a> 
conical VOLUME OF CONTENTS = 1/3 * a * RC* * AG 
A 
RC * A =AC*R 
‘ AC 
Ww 
Rc 

disk AREA = 2 * x * R@ 

VOLUME = x * R? * THICKNESS 
ladder L2 = x2 + y2 
shadow Y* (HL - H) =H*¥X a" 

Z=X+¥ a { 

3 x Me 

spherical VOLUME = 4/3 * x* R Lo 

AREA = 4 % x * R2 = 

DIAMETER = 2 * R 

w 
| oi 
trough VOLUME OF CONTENTS = 1/2 * L * WC * AC 
A 


KNOWLEDGE ABOUT OBJECTS 


cone 
conical 
disk 
sphere 
spherical 


trough 


wo * A = AC * W 


SS 


L 
ft 
i 
1 bac 
‘ H 
1 ry 
. ry : LH 
is a conical object we 
has altitude, contents, base with radius 
has radius, width, volume, and area 
is a spherical object 
has area, volume, diameter, and radius 


has altitude, width, and length 
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TABLE 4: CONTINUED 


KEY WORDS FOR DETERMINING PROBLEM TYPE 


DISTANCE KEYS 


approaching, distance, separating; ladder, pole, rail; shadow 


VOLUME KEYS 


altitude, area, diameter, radius, surface, volume 


ADJECTIVE TYPES 


conical - shape cylindrical - shape green - color 


rectangular - shape red - color spherical - shape 


DIRECTION WORDS 


above +K east +I horizontally +I level +1 north -J 
over 4K south +J vertically +K west -I 


OTHER KNOWLEDGE 


altitude implied by the words deep, depth, height, high, rising, and tall 
sometimes by surface and level 

AM implies the number preceding it in hours 

balloon spherical, it and its contents have the same volume, radius, etc. 

heap it and its contents have the same volume, etc. 

Joe is a person 

length is implied by the words long and lengthening 

level in a noun phrase implies altitude 

Mary is a person 

midnight zero hours 

moving implies position 

noon 12 hours 

pile it and its contents have the same volume, etc. 

PM adds 12 hours to the number preceding it 

surface if followed by AREA implies area, if followed by a verb which 


indicates altitude (such as rising) implies altitude, else 
implies area 


vertical surface is implied by fence, house, or wall 


Tnis was easy to find since both of these facts were hunca from the sane 


node on the structure. ‘This ecuation is solved for the value of time, 


which in turn is substituted into the differentiate? stuation. The 


latter is tuen simplifies, and the program prints out 


(THE ANSWEP TS) 
(TIMES .53132943 IN (EXPT SEC -1.9) (EXPT PT -0.33333332)) 


, ; . fi =173 
In conventional notation this would be .53 (7) / hf Ss 


a 
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VII. CONCLUSIONS AND SUGGESTIONS FOR FURTHER WORK 

In Chapter 2 we noted several aspects of STUDENT which we felt 
needed further work. Let us compare CARPS and STUDENT in these areas. 
1) By storing information in terms of structures, CARPS is better 
able to recognize that two phrases describe the same object. 
2) Again because of the use of structures CARPS can gather information 
about an object in piecemeal fashion. STUDENT was essentially required 
to generate one equation for each sentence in the problem description. 
In calculus word problems it is not uncommon to have two or three 
sentences providing information for one equation. 
3) CARPS to a limited degree is able to use its knowledge to parse 
its input sentences. For example we saw in Chapter 5 how ALTITUDE was 
interpreted as ALTITUDE OF THE FILTER because CARPS knew that since 
the filter was a cone and cones have altitudes, the filter had an 
altitude. There was no similar capability in STUDENT. 
4) Whereas STUDENT has only one solution method (i.e., solution of 
linear equations), CARPS has several and can decide which is appropriate 
for a given problem. CARPS' machinery for solving its equations 
(e.g., differentiation, simplification) is also more complex than STUDENT's. 
5) CARPS utilizes a more sophisticated grammatical analysis of the 
sentences than STUDENT. This is used both in breaking up sentences 
and in generating the internal structures. Up to now 14 problems have 
been solved by CARPS. These are listed in appendix A along with any 


modifications that were made to the original textbook statement of the 
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problems in the case that they were taken from a text. We believe 
that CARPS generally requires less modification of the original 
problem statement in order to obtain a solution than did STUDENT. 
Problems 2 and 12 indicate that CARPS is able to handle significantly 
different wordings of the same problem. Similar variations in the 
statements of problems would, of course, increase the number of 
problems solvable by CARPS. 

Many of the improvements that we claim for CARPS were 
necessitated by the increased complexity of the problems that we 
expected it to solve. However many weaknesses of STUDENT are still 
present in some form in our design. 
1) Probably the most important weakness in the program is due to its 
dependence on key words to signify the type of problem (i.e, distance 
or volume) and the method of solution to be used. What one would like 
to have in a calculus problem solver is a program which would use the 
information presented in the problem to figure out relationships among 
the elements (e.g., similar triangles) and actually propose the method 
of solution. Such a program would probably require a "geometry problem 
solver", a routine which can be asked questions like “what is a relation- 
ship between the radius and the altitude of the cone A?" or "What is the 
area of a parallelogram with sides a and b and base angles c and d?". 
The answers which could be provided by such a program are currently built 
into CARPS' data base for several cases, but this scheme severely limits 


the power of the program. 
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2) Another weakness of CARPS is its limited knowledge of English 
syntax. It would not be too difficult for CARPS to learn new 
syntactic rules by adding these rules to its CONVERT subroutines. 
Actually what would be more satisfying would be a different method of 
parsing the sentences into components of structures. Currently the 
CONVERT rules are attempted one at a time until one matches the 
sentence. A better approach would be an incremental left to right 
parse which, when finished with the sentence, would have translated it 
into the internal model. Such a routine most likely would switch 
between several levels of analysis. At one end we would have purely 
syntactic considerations, and on the other a semantic analysis based 
upon the information from its general world knowledge. The semantic 
information gathered in the begining of a sentence could be used to 
analyze later parts of the same sentence. A scheme such as this is 
described in Winograd (11). 

3) A very powerful calculus word problem solver will require a good 
deal of “common sense" knowledge. Consider this problem which we gave 


to CARPS 


(A LADDER 20.0 FT LONG LEANS AGAINST A HOUSE /. FIND THE RATE AT 
WHICH THE TOP OF THE LADDER IS MOVING DOWNWARD IF ITS FOOT IS 
12.0 FT FROM THE HOUSE AND MOVING AWAY AT THE RATE 2.0 FT PER 
SEC /.) 


Much to our surprise CARPS was not able to solve it. A closer look at 
the problem shows why. The last phrase mentions that the ladder is 
moving at the rate 2 ft per second. CARPS has, as an internal check, 


the requirement that associated with each velocity must be the direction 
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of the velocity. The point is that the problem never gave this direction. 
Most people however, would assume that it was moving directly away from 
the house. The reason of course, is that a familiarity with ladders 
or gravity tells us that this is the most likely way for it to be moving. 
Nor is this an isolated incident. Consider the problem 
( BARGE WHOSE DECK IS 10 FT BELOW THE LEVEL OF A DOCK IS BEING 
DRAWN IN BY MEANS OF A CABLE ATTACHED TO THE DECK AND PASSING 


THROUGH A RING ON THE DOCK. WHEN THE BARGE IS 24 FT FROM AND 


APPROACHING THE DOCK AT 3/4 FT / SEC, HOW FAST IS THE CABLE BEING 
PULLED IN?) 


Make a sketch of this situation for yourself. Most all people will draw 


10 FT 


3/4 FT/SEC 
_ OO 


AQFT 


Fig. 7 


Clearly when we say APPROACHING THE DOCK we mean at the level of the 
boat. Once again information of gravity would lead to this result. 
Yet there are still further difficulties in the problem as stated. 
The phrase "24 FT FROM ... THE DOCK" also meams at the level of the 


boat. Consider instead the problem 


(A BOY IS FLYING A KITE AT A HEIGHT 150 FT /. IF THE KITE MOVES 
HORIZONTALLY AWAY FROM THE BOY AT THE RATE 20.0 FT PER SEC /, HOW 
FAST IS THE STRING BEING PAID OUT WHEN THE KITE IS 250.0 FT FROM 
HIM ?) 
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It is just as clear that this time the picture is 
ao FT/SEC 


29 


150 FT 


K 


Fig. 8 


So the phrase "from him" means the total distance from the kite to the 
boy. The difference here is that while docks extend downwards (to the 
level of the boat), kites do not. 

Semantic difficulties such as these arise again and again in 
calculus problems. While we do not present any plan for the manner in 
which this information should be incorporated, it is clear that a great 
deal of “real world" knowledge is needed in solving calculus word 
problems, and for that matter in the understanding of natural language 


in general. 
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APPENDIX A 


1 (WATER IS FLOWING INTO A CONICAL FILTER AT THE RATE OF 15.0 CUBIC 
INCHES PER SECOND /. IF THE RADIUS OF THE BASE OF THE FILTER IS 5.0 
INCHES AND THE ALTITUDE IS 10.0 INCHES /, FIND THE RATE AT WHICH THE 


WATER LEVEL IS RISING WHEN THE VOLUME IS 100.0 CUBIC INCHES /.) 


2 (A MAN 6.0 FT TALL WALKS AT THE RATE 5.0 FT PER SECOND TOWARD A 
STREET LIGHT WHICH IS 16.0 FT ABOVE THE GROUND /. AT WHAT RATE IS THE 
TIP OF HIS SHADOW MOVING?) 

Taken from Thomas (8), page 100. The problem originally asked 


two questions, only the first is in our problem. 


3 (SHIP P IS 15.0 MILES EAST OF O AND MOVING WEST AT 20.0 MILES PER 
HOUR; SHIP B /, 60.0 MILES SOUTH OF 0 /, IS MOVING NORTH AT 15.0 
MILES PER HOUR /. AT WHAT RATE ARE THEY APPROACHING OR SEPARATING 
AFTER 1.0 HOUR /.) 

Problem taken from Ayres (1), page 59. Three changes were made. 
SHIP P was originally SHIP A (the A would have been removed along with all 
THE's), the question originally read "Are they approaching or separating 


after 1 hr and at what rate?", and there were two other questions. 
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4 (LADDER 20.0 FEET LONG LEANS AGAINST A HOUSE/. FIND THE RATE AT 
WHICH THE TOP OF THE LADDER IS MOVING IF ITS FOOT IS 12.0 FEET FROM 
THE HOUSE AND MOVING AWAY FROM THE HOUSE AT THE RATE 2.0 FEET PER 
SECOND/.) 

Taken from Ayres page 59. The problem originally asked two 


questions. 


5 (A TRAIN STARTING AT 11.0 AM /, TRAVELS EAST AT 45.0 MILES PER 
HOUR WHILE ANOTHER /, STARTING AT NOON FROM THE SAME POINT /, TRAVELS 
SOUTH AT 60.0 MILES PER HOUR /. HOW FAST ARE THEY SEPARATING AT 3.0 PM ?) 


Taken from Ayres page 59, no changes. 


6 (GAS IS ESCAPING FROM A SPHERICAL BALLOON AT THE RATE OF 2.0 CUBIC 
FEET PER MINUTE /. HOW FAST IS THE SURFACE AREA SHRINKING WHEN THE 
RADIUS IS 12.0 FEET ?) 


Taken from Ayres page 57, no changes. 


7 (A BALLOON IS RISING VERTICALLY OVER A POINT B AT THE RATE 15.0 
FEET PER SECOND /. A POINT C IS LEVEL WITH B AND IS 30.0 FEET FROM B /. 
WHEN THE BALLOON IS 40.0 FEET FROM B /, AT WHAT RATE IS ITS DISTANCE 


FROM C CHANGING ?) 


8 (A SHIP IS 30.0 MILES SOUTH OF POINT O AND TRAVELING EAST AT 25.0 
MILES PER HOUR /. HOW FAST IS THE DISTANCE FROM THE SHIP TO 0 


INCREASING ?) 
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9 (UPON BEING HEATED /, A METAL DISK EXPANDS /. THE RADIUS OF THE 
DISK LENGTHENS AT THE RATE OF .01 IN PER SEC /. CALCULATE THE RATE AT 
WHICH THE AREA OF THE DISK IS INCREASING WHEN THE RADIUS IS 3.0 IN /.) 
Taken from Lightstone (5) page 145. The problem originally had 
two questions and the first two sentences above were connected by the 


phrase "in such a manner that". 


10 (SAND FALLS ONTO A CONICAL PILE AT THE RATE OF 10.0 FT3 PER MIN /. 


THE RADIUS OF THE BASE OF THE PILE IS ALWAYS EQUAL TO ONE HALF 


OF ITS ALTITUDE /. HOW FAST IS THE ALTITUDE OF THE PILE INCREASING 
WHEN IT IS 5 FT DEEP ?) 


Taken from Thomas page 106, no changes. 


11 (A RECTANGULAR TROUGH IS 9.0 FT LONG /, 2.0 FT WIDE /, AND 4.0 
FT DEEP /. IF WATER FLOWS INTO THE TROUGH AT THE RATE 2.0 FT3 PER 
MIN /, HOW FAST IS THE SURFACE OF THE WATER RISING WHEN THE WATER IS 
1.0 FT DEEP ?) 

Taken from Ayres page 59. Rather than WIDE the problem had 
“across the top", instead of INTO THE TROUGH the problem had "in", and 


instead of SURFACE OF THE WATER the problem had just "surface". 


12 (A MAN WALKS AWAY FROM A STREET LIGHT AT 4.0 FT PER SECOND /. 
HOW FAST IS THE POSITION OF THE TIP OF HIS SHADOW CHANGING IF HE IS 


5.0 FEET TALL /, WHILE IT IS 20.0 FEET TALL /.) 


RATE TS 


[Sit WHOSE 
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Tie 


THR. 


HRIGET IS 30. 


MILES PER 


ThE RATS 


DTAME TER 


O PRET /. IF 


iOUR /, PIND 


OF 4.0 SQUARE 


CHANGING AFTER 


JOF 


THE 


63 


Bibliography 


1 


10 


11 


Ayres, F., Theory and Problems of Differential and Integral Calculus, 
Schaum Publishing Co., New York, 1964. 


Bobrow, D. G. "Natural Language Input for a Computer Problem Solving 
System", Report MAC-TR-1, Project MAC, M.I.T., Cambridge, Mass., June 1964, 
Reprinted in Semantic Information Processing, MIT Press, 1968. 

Guzman A., and McIntosh, H. V., "A Miscellaney of CONVERT Programming", 
Memorandum MAC-M-346, Project MAC, M.I.T., Cambridge, Mass., April 1967. 
Guzman A., and McIntosh, H. V., "CONVERT", Communications of the ACM, 

Vol. 9, No. 8, August 1966. 

Lightstone, A. H., Concepts of Calculus, Harper and Row, New York, 1965. 
Moses, J., "Symbolic Integration", Report MAC-TR-47, Project MAC, M.I.T., 
Cambridge, Mass., December 1967. 

Raphael, B., "Operation of A Semantic Question-Answering System" Artificial 
Intelligence Project - RLE and M.I.T. Computation Center, Memo 59, 
November 1963. 

Thomas, G. B., Calculus and Analytic Geometry, Addison Wesley Publishing 
Co., Reading, Mass., 1959, 

Weizenbaum, J., "ELIZA-A Computer Program For The Study of Natural 
Language Communication Between Man and Machine", Communications of the ACM, 
Vol. 9,No. 1, January 1966, pp 36-43. 

Weizenbaum, J., "Contextual Understanding by Computers", Communications 

of the ACM, Vol. 10, No. 8, August 1967, pp 474-480. 

Winograd, T. “An Interpretive Theory of Language" Unpublished term paper, 


18.16J, Department of Mathematics, April 1968. 


UNCLASSIFIED 


Security Classification 


DOCUMENT CONTROL DATA - R&D 


(Security claasification of title, body of abstrect and indexing annotation must be entered when the overall report is classified) 
1, ORIGINATING ACTIVITY (Corporate author) 2a. REPORT SECURITY CLASSIFICATION 


Massachusetts Institute of Technology UNGLAPSLETED 


chiepaeal ies 
None 


3, REPORT TITLE 


CARPS, A Program Which Solves Calculus Word Problems 


4. DESCRIPTIVE NOTES (Type of report and inclusive datee) 
Masters Thesis, Department of Electrical Engineering, July 1968 
$. AUTHOR(S) (Laat name, firet name, initial) 


Charniak, Eugene 


6. REPORT DATE Ja. TOTAL NO. OF PAGES 7b. NO. OF REFS 
July 1968 64 11 


8a. CONTRACT OR GRANT NO. Qa. ORIGINATOR’S REPORT NUMBER(S) 


Office of Naval Research, Nonr-4102(01) 
b. PROJECT NO. MAC-TR-51 
NR 048-189 


c 9b. OTHER REPORT NO(S) (Any other numbers that may be 
. RR 003-09 -O1 assigned this report) : 
d. 


10. AVAILABILITY/LIMITATION NOTICES 


Distribution of this document is unlimited. 


11, SUPPLEMENTARY NOTES 12. SPONSORING MILITARY ACTIVITY 

Advanced Research Projects Agency 
3D-200 Pentagon 

Washington, D.C. 20301 


None 


13. ABSTRACT 


CARPS (CAlculus Rate Problem Solver) is a program written to solve calculus 


word problems, but is restricted to rate problems. The overall plan of the 


program is similar to Bobrow's STUDENT, the primary difference being the intro- 
duction of "structures" as the internal model in CARPS. Structures are stored 
internally as trees. Each structure is designed to hold the information gathered 
about one object. 

A description of CARPS is given by working through two problems, one in 
great detail. Also included is a critical analysis of STUDENT. 


14. KEY WORDS 


Calculus problem solving Multiple-access computers Real-time computers 
Computers Natural-language programs Time-sharing 
Machine-aided cognition On-line computers Time-shared computers 


DD 49,1473 (M.LT.) UNCLASSIFIED 


Security Classification 


